Is the entropy S q extensive or nonextensive? * 
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The cornerstones of Boltzmann-Gibbs and nonextensive statistical mechanics respectively are 
the entropies Sbg = -kJ2 i= iPi^Pi and S q = k (1 - 2 i=1 p/)/(3 ~ (? £ R; ft = Sbg)- 
Through them we revisit the concept of additivity, and illustrate the (not always clearly perceived) 
fact that (thermodynamical) extensivity has a well defined sense only if we specify the compo- 
sition law that is being assumed for the subsystems (say A and B). If the composition law is 
not explicitly indicated, it is tacitly assumed that A and B are statistically independent. In this 
case, it immediately follows that Sbg {A + B) = Sbg (A.) + Sbg{B), hence extensive, whereas 
S q {A + B)/k = [S q {A)/k] + [S q {B)/k] + (1 - q)[S q (A)/k}[S q {B)/k], hence nonextensive for q / 1. In 



the present paper we illustrate the remarkable changes that occur when A and B are specially corre- 
lated. Indeed, we show that, in such case, S q (A + B) = S q (A) +S q (B) for the appropriate value of q 
(hence extensive), whereas Sbg{A + B) ^ Sbg(A) + Sbg(B) (hence nonextensive). We believe that 
these facts substantially improve the understanding of the mathematical need and physical origin of 
nonextensive statistical mechanics, and its interpretation in terms of effective occupation of the W a 
priori available microstates of the full phase space. In particular, we can appreciate the origin of the 
following important fact. In order to have entropic extensivity (i.e., limjv^oo S(N)/N < oo, where 

N = number of elements of the system), we must use (i) Sbg, if the number W e " of effectively 



occupied microstates increases with N like W 



eff, 



if W 



eff, 



W ~ fi N {u> 1); (ii) S q with q = 1 - 1/p, 



N p < W (p > 0). We had previously conjectured the existence of these two markedly 
different classes. The contribution of the present paper is to illustrate, for the first time as far as 
we can tell, the derivation of these facts directly from the set of probabilities of the W microstates. 



I. INTRODUCTION 

A quantity X(A) associated with a system A is said 
additive with regard to a (specific) composition of A and 
B if it satisfies 



X{A + B) = X(A)+X(B) , 



(1) 



where + inside the argument of X precisely indicates that 
composition. For example, suppose we partition the inte- 
rior of a single closed bottle in two parts. If no chemical 
or other reactions occur between the gas molecules that 
might be inside the bottle, nor between these molecules 
and the bottle itself (and its internal physical partition), 
the number of gas molecules is an additive quantity with 
regard to the elimination of the partition surface. The 
same happens with the total energy of an ideal gas, where 
all interactions have been neglected, including the grav- 
itational one. More trivially, the total height of various 



*To appear in the Proceedings of the 31st Workshop of the Inter- 
national School of Solid State Physics "Complexity, Metastability 
and Nonextensivity" , held at the Ettore Majorana Foundation and 
Centre for Scientific Culture, Erice (Sicily) in 20-26 July 2004, eds. 
C. Beck, A. Rapisarda and C. Tsallis (World Scientific, Singapore, 
2005). 

ltsallis@santafe.edu, tsallis@cbpf.br 



(rectangular) doors is, practically speaking, an additive 
quantity, if we pile them one above the other one. Not 
so if we put them side by side! On an abstract level, it is 
clear that this additivity just corresponds to the number 
of elements of the union of two sets A and B that have 
no common elements. 

If, instead of two subsystems A and B, we have N of 
them (Ai, A 2 , A^), then we have that 



JV 



N 



(2) 



If the subsystems happen to be all equal (a quite common 
case), then we have that 



X(N) = NX(1) , 



(3) 



with the notations X(N) = X(J2 N =1 AA and X(l) = 
X{A X ). 

An intimately related concept is that of extensivity. 
It appears frequently in thermodynamics and elsewhere, 
and corresponds to a weaker demand, namely that of 



,. \X{N)\ 

km - — 77—— < 00 . 



(4) 



Clearly, all quantities tkat are additive with regard to 
a given composition, also are extensive witk regard to 



2 



that same composition (and lirri/v-foo X(N)/N — X(l)), 
whereas the opposite is not necessarily true. For ex- 
ample, the total energy, the total entropy and the total 
magnetization of the standard Ising ferromagnetic model 
with N spins on a square lattice are extensive but not 
additive quantities. In other words, they are asymp- 
totically additive, but not strictly additive. Of course, 
there are quantities that are neither additive nor even 
extensive. They are called nonextensive. All types of 
behaviors can exist, such as X(N) oc N" 1 (7 > 0). For 
instance, thermodynamical quantities that, with regard 
to some specific composition, exhibit 7 = are called 
intensive. Such is the case of the temperature, pres- 
sure, chemical potential and similar quantities in a great 
variety of (thermodynamically equilibrated) systems ob- 
served in nature. A less trivial example of nonexten- 
sive quantity emerges within a spatially homogeneous 
d— dimensional classical gas whose N particles (exclu- 
sively) interact through a two-body interaction poten- 
tial that is strongly repulsive at short distances whereas 
it is attractive at long distances, decaying like l/r a 
(r = distance between two particles), and < a/d. The 
total potential energy of such a system corresponds Q 
to 7 = 2 — a/d if < a/d < 1 (i.e., nonextensive), 
and to 7 = 1 for a/d > 1 (i.e., extensive). The to- 
tal potential energy of this particular model has a loga- 
rithmic -/V-dependance (i.e., nonextensive) at the limiting 
value a/d — 1. The Lennard- Jones model for gases corre- 
sponds to (a, d) = (6,3), and has therefore an extensive 
total energy. In contrast, if we assume a cluster of stars 
gravitationally interacting (together with some physical 
mechanism effectively generating repulsion at short dis- 
tances), we have (a, d) — (1, 3), hence nonextensivity for 
the total potential energy. The physical nonextensivity 
which naturally emerges in such anomalous systems is, 
in some theoretical approaches, desguised by artificially 
dividing the two-body coupling constant (which has in 
fact no means of "knowing" the total number of particles 
of the entire system) by 7V 1_a / d . For the particular case 
a = this yields the widely (and wildly!) used division 
by N of the coupling constant, typical for a variety of 
mean field approaches. See for more details. 

Boltzmann-Gibbs (BG) statistical mechanics is based 
on the entropy 

w 

S B g= -fcy^pjlnpi , (5) 
i=l 

with 

w 

X> = 1 , (6) 

i=l 

where pi is the probability associated with the i th micro- 
scopic state of the system, and k is Boltzmann constant. 
In the particular case of equiprobability, i.e., pi = 1/W 
(Vi), Eq. (5) yields the celebrated Boltzmann principle 
(as named by Einstein Q): 

S BG = k\nW . (7) 



From now on, and without loss of generality, we shall 
take k equal to unity. 

Nonextensive statistical mechanics, first introduced in 
1988 0, S H (see S ©, [3 EH El 13 13 113 for re- 
views), is based on the so-called "nonextensive" entropy 
S q defined as follows: 

i-y w v q 
s q = — {q e M; Sl = Sbg) ■ (8) 

For equiprobability (i.e., pi — 1/W, Vi), Eq. (8) yields 
S q = ln g W , (9) 
with the q-logarithm function defined |16( as 
z x ~ q - 1 

ln q z= — (z G M; z > 0; lm z = lnz) . (10) 

The inverse function, the q- exponential, is given by 

e* = [l + (l-g)z]VCi-«) (e j = e 2 ) (11) 

if the argument 1 + (1 — q)z is positive, and equals zero 
otherwise. 

The present paper is entirely dedicated to the analysis 
of the additivity or nonadditivity of Sbg an d of its gen- 
eralization S q . However, following a common (and some- 
times dangerous) practice, we shall from now on cease 
distinguishing between additive and extensive, and use 
exclusively the word extensive in the sense of strictly ad- 
ditive. 



II. THE CASE OF TWO SUBSYSTEMS 

Consider two systems A and B having respectively Wa 
and Wb possible microstates. The total number of possi- 
ble microstates for the system A + B is then in principle 
W = Wa+b = WaWb- We emphasized the expression 
"in principle" because, as we shall see, a more or less se- 
vere reduction of the full phase space might occur in the 
presence of strong correlations between A and B. 

We shall use the notation pf^ B (i — 1,2,..., Wa] 3 = 
1,2,..., Wb) for the joint probabilities, hence 

Wa Wb 

i=l j=l 

The marginal probabilities are defined as follows: 

Wb 

Pf = £4 +B > (13) 

hence 

Wa 
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and 



hence 



B. Two specially correlated subsystems 



B _ 



Wa 

E 



p a+b 



(15) 



W B 

5>f - 1 



(16) 



These quantities are indicated in the following Table 
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We shall next illustrate the importance of the spec- 
ification of the composition law. Let us consider two 
cases, namely independent and (specially) correlated sub- 
systems. 



A. Two independent subsystems 

Consider a system composed by two independent sub- 
systems A and B, i.e., such that the joint probabilities 
are given by 

A+B _ A B 



piy~=p?pf (v(i,j)). 

With the definitions 

W A W b 

S BG (A + B)^-J2T,P^ +B ^Pt B 

i=i j=i 



W A 



s bg (A)^-J2p a ^p? 



(17) 



(18) 



(19) 



and 



i=i 



W B 



(20) 



S BG (B) = -J2Pj^pf 

we immediately verify that 

S BG (A + B) =S BG (A) + S BG (B) (21) 

and, analogously, that 

S q (A + B) = S q (A) + S q (B) + (l-q)S q (A)S q (B) . (22) 

Therefore, S BG is extensive. Consistently, S q is, unless 
9=1, nonextensive. It is in fact from property (22) that 
the q 7^ 1 statistical mechanics we are referring to has 
been named nonextensive. 



Consider now that A and B are correlated, i.e. 

P*i 



A+B ^pfpf, (23) 



Assume moreover, for simplicity, that both A and B sys- 
tems are equal, and that Wa = W B = 2. Assume finally 
that the joint probabilities are given by the following Ta- 
ble (with 1/2 <p < 1): 



a\ b 


1 


2 




1 


2p-l 


1-p 


P 


2 


1-p 





1-p 




P 


1-p 


1 



It can be trivially verified that Eq. (21) is not satisfied. 
Therefore, for this special correlation, S BG is nonexten- 
sive. It can also be verified that, for q = and only for 
q = 0, the following additivity is satisfied: 



S (A + B) = So(A) + S (B), 



(24) 



therefore So is extensive. Indeed + B) = 2So(A) = 
2. We immediately see that, depending on the type of 
correlation (or lack of it) between A and B, the entropy 
which is extensive (reminder: as previously announced, 
we are using here and in the rest of the paper "extensive" 
to strictly mean "additive") can be S BG or a different 
one. 

Before going on, let us introduce right away the dis- 
tinction between a priori possible states (in number W) 

and allowed or effective states (in number W e ff). Let 
us consider the above case of two equal binary subsys- 
tems A and B and consequently W = 4. If they are 
independent (i.e., the q = 1 case), their generic case 
corresponds to < p < 1, hence W e ff = 4. But if 
they have the above special correlation (i.e., the q = 
case), their generic case corresponds to 1/2 < p < 1, 

hence W e ff = 3 (indeed, the state (2,2), although pos- 
sible a priori, has zero probability). This type of dis- 
tinction is at the basis of this entire paper. Notice also 
that the q = 1 and q — cases can be unified through 
W e ff= [2 1 -9 + 2 1 -9-l] 1 /(i-<?) = [2 2 -9-l] 1 /(i-9). This 
specific unification will be commented later on. 

Let us further construct on the above observations. Is 
it possible to unify, at the level of the joint probabilities, 
the case of independence (which corresponds to q = 1) 
with the specially correlated case that we just analyzed 
(which corresponds to q = 0)? Yes, it is possible. Con- 
sider the following Table: 
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a\ b 


1 


2 




1 


fq(p) 


P - fqip) 


P 


2 


P-fqip) 


l-2p + f g (p) 


1-P 




P 


1-P 


1 



where f q (p) is given by the following relation: 
2p«+2(l-p)«-(/,)«-2(p-/,)«-(l-2p+/,)« = 1, (25) 

with / g (l) = 1, and < q < 1 (later on we shall comment 
on values outside this interval). Typical curves f q (p) are 
indicated in Fig. 1. Since Eq. (25) is an implicit one, 
they have been calculated numerically. It can be checked, 
for instance, that f q (l/2) smoothly increases from zero 
to 1/4 when q increases from zero to unity, being very 
fiat in the neighborhood of q = 0, and rather steep in the 
neighborhood of q = 1. The interesting point, however, 
is that it can be straightforwardly verified that, for the 
value of q chosen in f q (p) defined through Eq. (25) (and 
only for that q), 
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S q (A + B) = 2S q {A) =2 _ 1 . (26) 

where we have used the fact that A = B. In other words, 
we are facing a whole family of entropies that are exten- 
sive for the respective special correlations indicated in 
the Table just above. 

Let us proceed and generalize the previous examples to 
two-state systems A and B that are not necessarily equal. 
The case of independence is trivial, and is indicated in 
the following Table: 



a\ b 
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2 
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P?P B 
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P?P? 


P2P2 


P2 




P? 


P2 


1 



Of course, Eq. (21) is satisfied. 

Let us consider now the following Tabic (with p? + 
P? > 1): 



a\ b 


1 


2 




1 


P?+P? - 1 


1-P? 


p A 


2 


1-P? 





1-P? 




P? 


1-P? 


1 



We verify that Eq. (24) is satisfied. Is it possible to unify 
the above anisotropic q = 1 and q = cases? Yes, it is. 
The special correlations for these cases are indicated in 
the following Table: 



FIG. 1: The function f q (p), corresponding to the two-system 
A = B case (with Wa = Wb = 2), for typical values of 
q € [0,1]. A few typical nontrivial (q,f q (l/2)) points are 
(0.4, 0.043295), (0.5, 0.064765), (0.6, 0.087262), (0.7, 0.111289), 
(0.8, 0.138255), (0.9, 0.171838), (0.99, 0.225630). It can 
be easily verified that these values satisfy the relation 
2 1 -" - [/,(l/2)]« - [(1/2) - f q (l/2)]« = 1/2, which is the 
simple form that takes Eq. (25) for the p = 1/2 particular 
case. We also remind the trivial values /o(l/2) = and 
/i(l/2) = l/4. 



a\ b 


1 


2 




1 


fq(P?,P?) 


P?~fq(p?,P?) 


P ? 


2 


P?-f q ( P ?,P?) 


1-P?-P? +fq(P?,P?) 


1-P? 




P? 


1-P? 


1 



where f q (p?,p?) = f q (p?,p?), f q (p,l) = p, f q {p,p) = 
Up), fi(p?,P?) = P?P? : and f (p?,p? ) = P?+P? - 1. 
For any value of q in the interval [0, 1], and for any prob- 
abilistic pair (p?,p? ), the function f q (p?,p?) is (implic- 
itly) defined through 



(p?) q + (i-P?) q + ( P ?) q + (i- P ?y 

-[fq(P?,P?)\ 9 
-\p?-fq(P?,P?)} q -\p?-fq(P?,P?)} q 

-[l-p?-p? + f q ( P ?,P?W = l (27) 

(We remind that, for the q = particular case, it must 
be p? + p? > 1). We notice that the special correla- 
tions we are addressing here make that all joint probabil- 
ities can be expressed as functions of only one of them, 
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say p A ^ B , which is determined once for ever. More 
explicitly, we have that p A ^ B = pf - pf^, p A f B = 

rP - n A+B n A+B - 1 - n A - rP - n A+B 
Pi Pll i P22 — 1 Pi Pi Pll 

Eq. (27) recovers Eq. (25) as the particular instance 
Pi = Pi ■ And we can easily verify that, for < q < 1, 

S q (A + B) = S q (A) + S q (B) . (28) 

So, we still have extensivity for the appropriate value of 
q, i.e., the value of q which has been chosen in Eq. (27) 
to define the function f q (x,y) reflecting the special type 
of correlations assumed to exist between A and B. In 
other words, when the marginal probabilities have all the 
information, then the appropriate entropy is Sbg- But 
this happens only when A and B are independent. In 
all the other cases addressed within the above Table, the 
important information is by no means contained in the 
marginal probabilities, and we have to rely on the full set 
of joint probabilities. In such cases, Sbg is nonextensive, 
whereas S q is extensive. 

Before closing this section dedicated to the case of two 
systems, let us indicate the Table associated to the q = 
entropy for arbitrary systems A and B: 



a\ b 


1 


2 




W B 




1 




Pi 




Pw b 


p? 


2 


P2 










P2 














w A 


Pw A 










Pw A 




p? 


P B 2 
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We easily verify that Eq. (24) is satisfied. For example, 
the generic case corresponds to all probabilities in the 
Table being nonzero, excepting those explicitly indicated 
in the Table. For this case we have So(A) = Wa — 1, 
S (B) = W B - 1, and S {A + B) = W A + W B - 2. 
This is a neat illustration of the fact that, although 
the full space admits in principle W = W aW b rni- 
crostates, the strong correlations reflected in the Table 
make that the system uses appreciably less, namely, in 
this example, W e $ = Wa + Wb — 1- It is tempting 
to conjecture the generalization of this expression into 
W e ff = [W\- q + W x B q - l]V(i-9) for < q < 1. It 
is clear that W e " < WaWb, the equality holding only 
for q = 1. Since, strictly speaking, Wa, Wb and W e $ 
are integer numbers, this expression for W e $ can only 
be generically valid for real q ^ 0, 1 in some appropriate 
asymptotic sense. This sense has to be for W A , Wb » 1, 
which however are not fully addressed in the present pa- 
per for q ^ 0, 1. For the particular instance A = B, we 
have W e ff= [2W\- q - l]V(i-fl). 

We also verify another interesting aspect. If A 
and B are independent, equal values in the marginal 



probabilities are perfectly compatible with equal values 
in the joint probabilities. In the most general inde- 
pendent two-system case, we can simultaneously have 
p A = 1/W A (Vi), pf = 1/W B (Vj), and p A+B = 
1/(WaWb) This is not possible in the above 

Table. Indeed, equal probability values for all allowed 
microstates in the Table imply pfj +B — 1/(Wa + Wb — 
1) (V(z,j)), which is incompatible with equal values for 
the marginal probabilities. This fact starts pointing into 
what kind of (irreducibly correlated) situation, the usual 
BG microcanonical hypothesis "equal probability occu- 
pation of the entire phase space" for thermal equilibrium 
might become inadequate. It is very plausible that a vari- 
ety of microscopic dynamical situations must exist (e.g., 
long-range-interacting Hamiltonian systems) for which 
the standard equilibrium hypothesis is an oversimplifi- 
cation for physically relevant stationary states that do 
not correspond to thermal equilibrium. 



III. THE CASE OF THREE SUBSYSTEMS 

Consider now three systems A, B and C, having re- 
spectively Wa, Wb and Wc possible microstates. The 
total number of possible microstates for the system A + 
B + C is then in principle W = Wa+b+c = W aW b Wc- 
As for the case of two systems, we shall see that strong 
collective correlations between A, B and C may cause a 
severe reduction of the allowed phase space. 

We shall use the notation pf^ B+C (i = 
1,2,. ..,W A ; j = 1,2,. ..,W B ; k = 1, 2, Wc) for the 
joint probabilities, hence 

W A W b W c 

EEEC +C = 1 ' ( 29 ) 
»=i j=i fe=i 

The AB— marginal probabilities are defined as follows: 

W c 

4 +B -E^ B+c > (3°) 

k=l 

hence 

Wa Wb 
i=l j=l 

Similar expressions exist for the AC— and BC— marginal 
probabilities. The joint probabilities for the Wa = Wb = 
Wc = 2 case arc indicated in the following Table, where 
the numbers without parentheses correspond to system 
C in state 1, and the numbers within parentheses corre- 
spond to system C in state 2. 
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A+B+C 
Pill 

(P?it B+C ) 


A+B+C 
Pl21 

{P^2 B+C ) 
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pf+Pf + pf -2 
(1-Pf) 


1-pf 
(0) 
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A+B+C 
Pill 

(P^ B+C ) 


A+B+C 
-P221 


2 


1-P? 
(0) 




(0) 



The corresponding AB— marginal probabilities are in- 
dicated in the Table below: 



a\ b 


1 


2 


1 


P?i +B 


P?2 +B 


2 


P?i +B 


P^ B 



which of course reproduces the situation we had for the 
two-system (^4 + B) problem. This is to say pf^ B = 
Piii B+C + Pii2 B+C i and so on. 



A. Three independent subsystems 

Consider first the case where all three subsystems A 
and B are binary and statistically independent, i.e., such 
that the joint probabilities are given by 



A+B+C 
Pijk 



(32) 



The corresponding Table is of course as follows 



a\ b 
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pfpfpf 
{pfPiPf) 


P1P2P1 
{P1P2P2) 
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P2P1P1 
(P2P1P2) 


P2P2P1 
(P2P2P2) 


We immediately verify that 




S BG (A + B + C) 


= Sbg(A) - 





Therefore, Sbg is extensive. Consistently, S q is, unless 
9=1, nonextensive. 



B. Three specially correlated subsystems 

Consider now that the three binary subsystems are cor- 
related as indicated in the next Table (with pf + pf + 
P? > 2): 



We easily verify that 

S (A + B + C) = S (A) + So(B) + S (C) . (34) 

For example, if A = B = C and 2/3 < p < 1, we have 
that S (A + B + C) = 3S (A) = 3. 

Let us next unify the q = 1 and the q = cases. We 
heuristically found the solution. It is indicated in the 
following Table: 



a\ b 
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f q (ptP?) + f q (P?,P?) 


-fM,pf) 




-P?(Pi+Pi) 


+pf(p? +p?) 




+ P ?fM,p?) 


- P ?f q (p?,p?) 




[f q ( P A ,p?)+p?(pf+p?) 


\p?(i-p?-p? 




-fM,p?)-f q (pf,p?) 


+f q (p?,p?))} 




- P ?fM,P?)} 
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-fM,p?)+pf(p?+p?) 


p?(i-pf-pf 




-P B fM,p?) 


+fM,pf)) 




\pf(i-p?- P ? 


[(i-p?)(i-pt- P f 




+fM,p?))} 


+f q (p?,pf))\ 



where the function f q (x,y) is defined in Eq. (27). In- 
terestingly enough, it has been possible to find a three- 
subsystem solution in terms of the two-subsystem and 
one-system ones. More explicitly, we have, for example, 
thatpf+ B+c = f q (p?,P?) + f q (P?,P?)-P?(P?+P?) + 

P?fM,P?) = Pti +C +Pn +B -P?(P? +P?)+P? P fi +B , 
and similarly for the other seven three-subsystem joint 
probabilities. Of course, all eight joint probabilities asso- 
ciated with the above Table are nonnegative; whenever 
the values of (pf ,p B ,pf ) replaced within one or the other 
of these analytic expressions yield negative numbers, the 
corresponding probabilities are to be taken equal to zero. 

The AB— marginal probabilities precisely recover the 
joint probabilities of the previously discussed two-system 
'{A + B) Table. For example, [f q {pf,p? ) + Upf ,pf ) - 

p? (pf+pf ) +p? fM, p? )} + lf q (pf, p? ) +p?(p?+p? ) - 

„A n C\ 



f q (p?,p¥) - f q (rt,P?) - P?fM,P B )} = f q (P?,P B ), 



p?f q (p B ,p?)} + btf(i - 
f q (pi,pf), and s ° ° n - 



. fM,pf)+P?(pf +p?) 

p?-p?+.f q ( P B , P m=pf 

Finally, we verify that 
S q {A + B + C) = \[S q {A + B) + S q (A + C) 



S q (B + C)} 



7 



For the particular case A 
becomes 



= S q (A) + S q (B) + S g (C) (35) or, equivalents 

B = C, the above Table 



N 



N 



A\ 


1 


2 


1 


2(f q (p)-p 2 )+pf q (p) 


2 P 2 - f q (p) - P.f q ( P ) 




W f q ( P ) P f q (p)} 


[p(l-2p + /,(p))] 


2 


2p 2 - f g ( P ) - Pf q (p) 


p(l-2p + f q (p)) 




[p(l-2p + f q (p))\ 


[(l-p)(l-2p + /,(p))] 



where we have used f q (p,p) = f q (j>)- 

For the generic case of three subsystems with Wa, 
Wb and Wc states respectively, we have that W — 
WaWbWc, whereas in the appropriate asymptotic sense 
we expect W e ff = [W A ' q +W B ~ q +W c ~ q -2]V(i-9) < W 
for < q < 1 (the equality generically holds only for 
q = 1). In the particular instance A = B = C, this 

expression becomes W e S '= [3W A ~ q - 2] 1 /< 1 -«). 



IV. ENLARGING THE SCENARIO 
A. The case of N subsystems 

The three-system case discussed above is a generic one 
under the assumption that Wa = Wb = Wc — 2. We 
have not attempted to generalize its corresponding spe- 
cial correlation Table to the generic (Wa, Wb,Wc) case, 
and even less to the even more generic case of N such sys- 
tems (Ai, A 2 , ...,An). It is clear however that, assuming 
that this (not necessarily trivial) task was satisfactorily 
accomplished, the result would lead to 



(36) 



where q = 1 if all N systems are mutually independent, 
i.e., 



N 



P^£- +AN = Upt (V(u,* 2 ,...,*aO), (37) 



and g ^ 1 otherwise. This is to say, if we have indepen- 
dence, the only entropy which is extensive is Sbg- If we 
do not have independence but the special type of (collec- 
tive) correlations focused on in this paper instead, then 
only S q for a special value of q is extensive. 

For the case of independence, the generic composition 
law for S q is given by 



N 



N 



ln[l + (1 - q)S q (J2 A r )] - J2 M 1 + 0- ~ l) S i( A r)} . 

(38) 



r=l 



r=l 



1 + (1 - q)S q (J2 A) = I] I 1 + (! - l)S q (Ar)} ■ (39) 



r=l 



r=l 



Eq. (38) exhibits in fact the well known (monotonic) 
connection between S q and the Renyi entropy = 



/(I - q) 



In[l + (l-«)S,]j/(l-«) (we 
remind that, for independent systems, is extensive, 

v«). 

We have generically W = Yl r= iWA r , which corre- 
sponds of course to the total number of a priori pos- 
sibly occupied states (i.e., whose joint probabilities are 
generically nonzero) for the generic q = 1 case. In 

contrast, the generic q — case has only W e ff = 



(Er=lW Ar )-(N- 



are p ^+^+-+A N 
M 



1) nonzero joint probabilities. These 

= (EtiPf) - (N -1) > 0, 

Piiii...i = V'iX (h = 2,3,..., W Al ), Ph 2 h...i = pf 2 2 

{i 2 = 2,3,...,W A2 ),Piu... iN =pf N N (i N = 2,3,...,W An ). 
The generic q — 1 and q — cases can, analogously to 

what has been done before, be unified through W e ff — 

< W (0 < q < 1), where 

1. In the particular in- 
stance A\ = A 2 = ... = A N = A, this expression becomes 
W e ff = [NW A - q - (JV - l)] 1 /^-"). 

Furthermore, for iV equal subsystems (a quite frequent 
case, as already mentioned), Eq. (36) becomes 



(Er =1 WA- q )-(N-l)_ 

the equality holds only for q 



S q (N) =NS q (l). 



(40) 



where the change of notation is transparent. This is an 
extremely interesting relation since it already has the 
shape that accomodates well within standard thermo- 
dynamics, even if the entropic index q is not necessar- 
ily the usual one, i.e., q = 1. It is allowed to think 
that Clausius would perhaps have been as satisfied with 
this relation as he surely was with the same relation but 
with Sbg 1 - One might also quite safely speculate that 
if the system is such that its Table of joint probabili- 
ties is not exactly of the type we have discussed here, 
but close to it, then we might have, not exactly rela- 
tion (40) but rather only asymptotically S q (N) cx N. In 
other words, as long as the system belongs to what we 
may refer to as the q— universality class, we should ex- 
pect limjv->oo S g (N)/N < oo, in total analogy with the 
usual BG case. 

To geometrically interpret Eq. (40), we may consider 
the case of equal probabilities in the allowed phase space, 
i.e., in that part of phase space which is expected to have, 
not necessarily W microstates, but generically W e $ mi- 
crostates (with W e ff < W). The effective number W e ff 
is expected (at least in the N >> 1 limit) to be precisely 
the number of all those states that the special collective 
correlations allow to visit. So, if we assume equal prob- 
abilities in Eq. (40) (i.e., ^ 1 l2 + ^ 2 JV + - +A " = l/W e ff), wc 
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obtain 



\n q W' 
or, equivalcntly 



NS q (l), (41) 



W e ff= ef 5 ' (1) = [1 + (1 - q)NS q {l)] l/{1 - q) . (42) 

Two cases are possible for this relation, namely q = 1 
and q < 1. In the first case, we have the usual result 



W e ff=W = f i N 



(43) 



with 



/i = e SsG(1) > 1. (44) 

In the second case, we have an unusual result, namely 

W e ff=[l + NS q {l)/ P r, (45) 

with 

p= 1/(1-9) >0. (46) 

In the N — > oo limit, this relation becomes the following 
one: 



W e ff(xN p . 



(47) 



This (physically quite appealing) possibility was infor- 
mally advanced by us long ago, and formally in [12j. It 
has now been obtained along an appropriate probabilistic 
path. 



B. The q 



-oo case 



From Eq. (46) we expect the q — ► — oo case to corre- 
spond to the limiting situation where W e ff is constant. 
To realize this situation, let us first consider the A = B 
two-system case with the following Table {Wa — Wb)' 



a\ b 


1 


2 




W A 




1 


Pi 











Pi 


2 





P2 








P2 

















W A 











PW A 


PW A 




Pi 


P2 




Pw a 


1 



This Table corresponds to p 



A+B 

ij 



Pi Sij . Its generaliza- 



tion to TV equal systems is trivial: Piit 2 ...tjv = Ph if all N 
indices coincide, and zero otherwise. The corresponding 
entropy therefore asymptotically approaches the relation 



S-oo(N) = S-oo(l) (VAO, 



(48) 



thus corresponding to p — as anticipated. It appears 
then that all cases equivalent (through permutations) to 
the above Table, should yield the same limit q — > — oo. 



C. Connection with the Borges-Nivanen-Le 
Mehaute-Wang q product 

Let us mention at this point an interesting connection 
that can be established between the present problem and 
the q— product introduced by L. Nivanen, A. Le Mehaute 
and Q.A. Wang and by E.P. Borges 0|- ^ is defined as 
follows: 



.1-9 



xx q y={x^ H +y^ *-l) 1 /(i 9) [xxiy = xy). (49) 

It has the elegant, extensive-like, property 

\n q (x x q y) = hx q x + In, y , (50) 

to be compared with the by now quite usual, 
nonextensive-like, property 

ln q (xy) — kig x + bx q y + (1 - q)(bx q x)(ln g y) . (51) 

This type of structure was since long (at least since 
1999) being informally discussed by A.K. Rajagopal, 
E.K. Lenzi, S. Abe, myself, and probably others. But 
only very recently it was beautifully formalized |17| . 
It has immediately been followed and considerably ex- 
tended by Suyari in a relevant set of papers [Isj . 

Let us now go back to the main topic of the present pa- 
per. Consider the following joint probabilities associated 
with N generic subsystems: 



A 1 +A 2 + ...+A^ 
Piii 2 ...i N 



where dr- ■ „ is a nontrivial function which ensures that 



l-N- 



6^ . - 

'lll2--.«JV 



JV 

-E^-r 1 

r=l 



1/(9-1) 



E 

iii 2 ...i N 



A 1 +A 2 + ...+A N _ -, 
Pi\i 2 ...i N 



(52) 
that 

(53) 



In the limit q — > 1, Eq. (52) must recover the 
independent-systems one, namely 



Ai+A3+...+A r 

ili 2 ...i N 



which implies 



P 



N 

= 1 1 pf; 



r=l 



(54) 



= 0. 



"t\t 2 ...tft 

Notice that, excepting for the function , Eq. 

„Ai+A 2 +...+A N __.ii. tt N h /„Ar 

ll 2 ...lN 



(52) associates 1 /pf \ 



with n 9 f =1 (Vpf r ") with 



,1-9 



[Xi i+X 2 

It follows from Eq. (52) that 



+ X2 1 -" + ...+XN 1 -" - N + l] 1 /(l-9) 



(Pi 



A 1 +A 2 + ...+A N ^q 
12. .An 



n A 1 +A 2 +-+Aj> 
ii 2 ...i N 



N 



M+A 2 +...+A N \^(p^)9-l 



r=l 



(55) 



hence 



E 

i\i 2 ...i N 



(ptt A C- +AN ) q = (l-N) 



N 

> „Ai+A 2 + ...+A N ST^ 
i\i 2 ...iN r—1 



(ptr- 1 



(56) 
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where we have imposed one more nontrival condition on 
namely that 

E Pt£X- +AN ^..A N =0- (57) 

ili2---ijv 

One might naturally have the impression that no function 

^iiL i« might exist satisfying simultaneously Eqs. (53) 
and (57). This is not so however, at least for particular 
cases, since we have explicitly shown in the present paper 
solutions of this nontrivial problem. 

Using the definition of S q in the left-hand member of 
the equality we obtain 

N 

(l-q)S g (£Ar) = 

r=l 

N 

E Pt^. A f:- +AN T,(j>t) q - 1 ~N. (58) 

Let us now introduce in Eq. (58) the definition of 
marginal probabilities, namely 

Vt= E P^C- +AN - (59) 

We obtain 

N N 

(l-q)S q C£A r )=J2(pt) q ~N . (60) 

r—l r—l 

Using once again the definition of S q on the right-hand 
member, we finally obtain 

N N 
r—l r—l 

as desired. 

It should, however, be clear that this remarkable math- 
ematical fact by no means exhausts the problem of the 
search of explicit Tables of joint probabilities that would 
lead to extensivity of S q for nontrivial values of q. The 
constraints imposed by the definition itself of the concept 
of marginal probabilities are of such complexity that the 
search of solutions is by no means trivial, at least at our 
present degree of knowledge. Indeed, one easily appreci- 
ates this fact by looking at the explicit solutions indicated 
in Sections II. B and III.B. 



V. CONCLUSIONS 

Let us summarize the obvious conclusion of the present 
paper: Unless the composition law is specified, the ques- 
tion whether an entropy (or some similar quantity) is 
or is not extensive has no sense. Allow us a quick di- 
gression. The situation is in fact quite analogous to the 



quick or slow motion of a body. Ancient Greeks consid- 
ered the motion to be an absolute property. It was not 
until Galileo that it was clearly perceived that motion has 
no sense unless the referential is specified. In Galileo's 
time, and even now, when no referential is indicated, one 
tacitly assumes that the referential is the Earth. In total 
analogy, when no composition law is indicated for ana- 
lyzing the extensivity of an entropy, one tacitly assumes 
that the subsystems that we are composing are indepen- 
dent. It is only — a big only\ — in this sense that we 
can say that Sbg is extensive, and that S q (for q ^ 1) is 
nonextensive. 

Once we have established the point above, the next 
natural question is: Are there classes of collective corre- 
lations for which we know which is the specific entropy 
to be extensive? (knowing, of course, that absence of all 
correlations leads to Sbg)- For this operationally impor- 
tant question, nontrivial illustrations on how the entropic 
form is dictated by the type of special collective correla- 
tions that might (or might not) exist in the system have 
explicitly presented in Section II. B and III.B. From this 
discussion, two vast categories of systems are identified 
(at the most microscopic possible level, i.e., that of the 
joint probabilities), namely those whose allowed phase 
space increases (in size) with N like an exponential or 
like a power-law, corresponding respectively to q = 1 and 
to q < 1. 

However, it should be clear that the present paper is 
only exploratory in what concerns this hard task. Indeed, 
we have not found the generic answer for N (not neces- 
sarily equal) systems, and we have basically concentrated 
only on the interval < q < 1. We do not even know 
without doubt if the answer is unique (excepting of course 
for trivial permutations) , or if it admits a variety of forms 
all belonging to the same universality class of nonexten- 
sivity (i.e., sharing the same value of the entropic index 
q). Even worse, we still do not know what specifically 
happens in the structure of the allowed phase space in 
the (thermodynamically) most important limit N — > oo, 
or in the frequent limit Wa ~ * 00 (which would provide 
a precise geometrical interpretation to a formula such as 
W e ff= [NW x A q — (N — f or say < q < 1). It 

is precisely this structure which is crucial for fully under- 
standing nonextensive statistical mechanics and its re- 
lated applications in terms on nonlinear dynamical sys- 
tems. For example, an interesting situation might occur 
if we compare the distribution which optimizes S q (N) 
and then consider N » 1, with the distribution corre- 
sponding to having first considered N >> 1 in S q (N) and 
only then optimizing. We certainly expect the thermody- 
namic limit and the optimization operation to commute 
for a system composed by N independent (or nearly in- 
dependent) subsystems. But the situation seems to be 
more subtle if our system was composed by N subsys- 
tems correlated in that special, collective manner which 
demands q 1 in order to have entropy extensivity. Such 
a situation would be consistent with a prop erty which 
emerges again and again 0, H, S EO, EH 13 E3, Q 113 
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for nonextensive systems, namely that the N — » oo and 
the t — ► oo limits do not necessarily commute. One more 
relevant issue concerns what specific dynamical nature is 
required for a physical system to "live" , in phase space, 
within a structure close to one of those that we have 
presently analyzed. It is our conjecture that this would 
occur for nonlinear dynamical systems whose Lyapunov 
spectrum is either zero or close to it, i.e., under circum- 
stances similar to the edge of chaos, where many of the 
so called complex systems are expected to occur. We 
leave all these questions as open points needing further 
progress. 

Let us finally mention the following point. It is by 
no means trivial to find sets of joint probabilities (asso- 
ciated to relevant statistical correlations) that produce 
very simple marginal probabilities (such as p and 1 — p 
for binary variables) and which simultaneously admit the 
imposition (as we have done here) of strict additivity of 
the corresponding entropy. This has been possible for 



S q . This might be in principle possible as well for other 
entropic forms. The fact however that, like Sbg> Sq si~ 
multaneously (i) admits such solutions, (ii) is concave 
(Vg > 0), (iii) is Lesche-stable, and (iv) leads to finite 
entropy production per unit time |12|. constitutes — we 
believe — a strong mathematical basis for being physi- 
cally meaningful in the thermostatistical sense. 
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